pages still show up in google search even after disallowed in robots.txt [duplicate]

Posted by Jota Onasys on Pro Webmasters See other posts from Pro Webmasters or by Jota Onasys
Published on 2014-08-20T01:48:17Z Indexed on 2014/08/20 4:31 UTC
Read the original article Hit count: 170

Filed under:

google

This question already has an answer here:

With Robots.txt disallow all, why was my site still getting traffic? 5 answers

Why is it that some pages still show up in google search even though disallowed in robots.txt?

Is the best solution here to remove the Disallow from Robots.txt and just add noindex, nofollow meta tag to those pages you want blocked?

Or should I submit a request to Google directly to remove those pages?

Related posts about google

Removing malware of a particular kind

as seen on Super User - Search for 'Super User'
I need to remove some malware from my computer. It is a trojan, and very annoying. It blocks access to Google and search sites. The trojan, with its name spelled out on each line cause it seems to block sites when i reference it in a url, is a r t (some text to mess it up) e m (more text i s First… >>> More
Trouble installing Matlab

as seen on Ask Ubuntu - Search for 'Ask Ubuntu'
So whenever I try to install Matlab, the first image appears, but then goes away and that's the end of it. Here's what I'm doing- user@host$> cd ~/mathworks_downloads user@host$> unzip matlab_R2012a_student_glnx86_installer.zip user@host$> ./install The Matlab logo and image pop up here… >>> More
Google chrome is always searching in local google domain instead of Google.com

as seen on Super User - Search for 'Super User'
I have changed in the searched preferences to google.com but still when I do search from the address bar (instant or non-instant) it will go to google.co.kr. Even though I change "Google.com in English", still same... The only way is to open google.com website first, then do search in it. So the… >>> More
Google I/O 2010: Google TV Keynote - Introducing Google TV

as seen on Google Code - Search for 'Google Code'
Google I/O 2010: Google TV Keynote - Introducing Google TV Due to licensing and permissions issues, we are unable to show the full Google TV demonstration from the Day 2 keynote at Google I/O. Until we are able to get these permissions, please check out these clips. For Google I/O session videos… >>> More
Google I/O 2010: Google TV Keynote - Android Apps On Google TV

as seen on Google Code - Search for 'Google Code'
Google I/O 2010: Google TV Keynote - Android Apps On Google TV Due to licensing and permissions issues, we are unable to show the full Google TV demonstration from the Day 2 keynote at Google I/O. Until we are able to get these permissions, please check out these clips. For Google I/O session videos… >>> More

Developer IT

pages still show up in google search even after disallowed in robots.txt [duplicate] - Developer IT

pages still show up in google search even after disallowed in robots.txt [duplicate]

google

Related posts about google

Removing malware of a particular kind

Trouble installing Matlab

Google chrome is always searching in local google domain instead of Google.com

Google I/O 2010: Google TV Keynote - Introducing Google TV

Google I/O 2010: Google TV Keynote - Android Apps On Google TV

Categories cloud